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Description 

[Method and apparatus to simulate an 
outdoor window for a windowless room] 

Background of Invention 
[1. Field of the Invention] 

[0001] The present invention relates to the simulation of an out- 
door window for a room without real window. It relates to 

the application of a surveillance system. 
[2. Background] 

[0002] Recent advances in display monitor technologies such as 
LCD and plasma displays have been obvious. It is easy to 
notice that the screens for televisions and personal com- 
puters have gradually become flat and getting bigger in 
size. In fact, they are not only getting bigger in display 
size, but also weighing lighter and getting more afford- 
able in the commercial market. As the advance of such 
display technology is going on, the big, flat and light in 
weight display screens will have more interesting applica- 



tions. For example, one ideal application for these big, flat 
display monitors is to use them to simulate the outdoor 
window for a windowless room. Anybody who works in a 
commercial office building knows that rooms with win- 
dows to see outdoor scene are always in great demand, 
and such outdoor scene accessible rooms usually are only 
assigned to those employees who hold higher positions. 
[0003] | n the mean time, the surveillance systems for monitoring 
specific locations are getting more popularity. Such sys- 
tem often equipped with at least a wireless video camera 
to obtain the dynamic image sequence from the surveyed 
locations. With the maturity of such kind technology, it is 
natural and of no difficulty to add function which will in- 
teractively create the image of window covering such as 
mini-blind according to user's input and superimpose the 
created image into the images displaying in such surveil- 
lance system, resulted to a simulated window system 
which looks like a real window with curtain and outdoor 
scene on display. Alternatively, we can mount the screen 
of the surveillance system on the wall in a windowless 
room, install the video camera at a outdoor location then 
put a real curtain or mini-blinds on the top of the display 
screen to have one form of the simulation of outdoor win- 



dow with real curtain. However, there will be no plurality 
of types and styles of the curtains in such arrangement 
and sometimes it is not easy to install particular style of 
curtains, blinds or the shades, and once installed, it is dif- 
ficult to replace to another one. Cost of window coverings 
is another factor for not to simulate with real curtains, 
since some curtains or shades may cost as much as the 
display screen, not to mention that there still a need for a 
control mechanism to automate the real curtain or an user 
input device to link the display and motion of the curtain 
position. 

[0004] while the commercial surveillance systems are used for 
monitoring scenes of interest for security or other rea- 
sons, most emphasis in designing such systems is in the 
motion detection from the clues reveal in the image se- 
quence. The purpose of present invention, on the other 
hand, is to provide dynamic view of interested outdoor lo- 
cations using display monitors with operable curtain im- 
age which looks similar to an outdoor scene accessible 
window with real curtain. It is fair to say that, in addition 
to it's functional value, the present invention also has 
great decoration value by mounting a beautiful simulated 
window on the wall. 



[0005] one feature of present invention is that the monitor 

mounted on the wall can also be used as computer moni- 
tor or as other display device, provided that the monitor 
has imbedded a selection switch to select to select from at 
least two modes of applications, one for simulation and 
another for TV or computer monitor. Multi-purpose moni- 
tors has become easier to implement because the increas- 
ing popularity of digital TV programs which are displayed 
in either plasma or LCD monitors-both accept digital sig- 
nals just like computer monitors. There is no question 
that the trend in the near future is to use digital signals 
for better video quality. We have already seen this hap- 
pens in TV cellular phone industries. 

[0006] Recent development in Wireless technology such as Blue- 
tooth has made wireless applications very convenient to 
implement. By using such technology in receiving the out- 
door images, the resulted window simulation system will 
be portable to mount on any wall where power is avail- 
able. Bluetooth can also be applied to the wireless com- 
munication between wall mounted monitor and computer 
such that operations on desktop keyboard/mouse can re- 
motely control the display on the monitor. 

[0007] There is no question that one who is familiar with the art 



of developing computer software for creating images can 
design software dedicated to creating the instant simula- 
tion images. But one should know that when the display 
screen is mounted on the wall as a requirement in present 
invention, it is difficult to hide the connection cable be- 
tween computer and display monitor, so a wireless com- 
munication between them would be assumed. Therefore, 
an extra cost already exist by using computer to process 
the simulation images. In fact, a stand alone embodiment 
of present invention offers many more advantages over 
embodiment that uses computer power and memory to 
achieve the simulation. First, not every windowless room 
has a computer. Standalone design make it portable to 
every windowless room. Second, the simulation process in 
present invention does not need as much computing 
power and storage memory as a typical personal com- 
puter, so it is good to have simpler CPU and memory to 
independently process the images. Personal computers 
usually take more than 30 seconds to boot up. It would be 
too tedious if one needs to start a computer before start- 
ing the window simulation every time unless the computer 
stays in running mode all day long. Third, using computer 
keyboard/mouse to move curtain up and down does not 



offer as good in simulation fidelity as using the user in- 
terface devices installed directly around the rim of the 

display screen. 
Summary of Invention 

[0008] a method and apparatus to simulate an outdoor window 
for a windowless room is provided. According to one as- 
pect of present invention, users of one embodiment of 
this invention will be able to see the outdoor scene in a 
windowless room with the choice of their favorite window 
coverings simulated on the screen, manipulate the simu- 
lated window coverings at their desired openings and po- 
sitions. As such, the resulted embodiment of this inven- 
tion is not only useful as a tool for displaying desired out- 
door scene for a windowless room, but also a good deco- 
ration item for such room to install. 
Brief Description of Drawings 

[0009] FIG. 1 shows how a typical commercial surveillance system 
relates to present invention in form of block diagram. The 
dashed-line parts in the drawing are the component and 
function added to a commercial surveillance system for an 
embodiment of an outdoor window simulation system. 

[0010] FIG. 2 Shows an embodiment of an outdoor window simu- 



lation system with an half opened, mid-positioned mini- 
blind in display. 

[0011] FIG. 3 is a block diagram showing the steps in creating in- 
stant simulation images. 
Detailed Description 

[0012] | n a simple surveillance system, as shown in FIG. 1, at 
least one video camera is used to take the pictures from 
desired locations and transmit the pictures at a fixed rate 
through wire or broadcast wirelessly through a transmitter 
to a receiver or multiplexer. The pictures may be pro- 
cessed in the multiplexer before being sent to one or 
more display monitors. A multiplexer accepts multiple in- 
puts through different channels at the same time, manip- 
ulate the these inputs into desired video signals and out- 
put signals through multiple channels to monitors at dif- 
ferent locations. Present invention takes wired or wireless 
camera input, but one input at a time and no need to send 
to multiple displays, so the conventional multiplexer is 
not needed in present invention. 

[0013] The dashed-line arrow and dash-line block in FIG. 1 show 
the major parts in present invention which do not exist in 
a commercial single input single output surveillance sys- 
tem. We see that an image processor, represented by the 



dashed-line block, receives signals from a receiver as well 
as from memory designated to store window structures 
and window coverings information, as represented by the 
dashed-line arrow, is used to create instant simulation 
images. As shown more details in FIG. 3, the image pro- 
cessor creates fixed window image based on the user's 
choice of type of window structure and then creates a 
window covering image based on user's choices of type, 
style and color and current settings of openness and posi- 
tion of the window covering before combining them into a 
static image. This image is static in the sense that it will 
stay the same until user inputs new openness or new po- 
sition through interface devices and consequently forces 
the image processor to redraw the static image. The im- 
age processor further combines the static image with cur- 
rent available image from the receiver into instant simula- 
tion image and sends to the display monitor at a typical 
display rate of 30 frames per second. 
[0014] |f the fixed window image and window covering image are 
considered as coming from two separated channels, then 
the image processor can be viewed as a special purpose 
three input one output multiplexer. While the function of a 
typical multiplexer is to combine the images from differ- 



ent locations into one display, or to perform some image 
processing in order to extract some clues for motion de- 
tection, the function of the image processor in present in- 
vention is to overwrite portions of the outdoor image by 
the contents in the static image. In most applications, the 
multiplexer is designed and built as a stand alone device 
and uses wires to connect to other devices. The preferable 
embodiment of present invention is to install the hard- 
ware of the image processor into the display monitor for 
considerations of portability and fidelity of simulation. 
[0015] FIG. 2 Illustrates a more detailed embodiment of present 
invention. In this particular embodiment, an outdoor win- 
dow with edges 210 at all four rims and a window grid 
209 consists of three grid members for separating the 
window into six equal portions is shown. Also shown in 
FIG. 2 is the example of using mini-blind as the window 
covering. The mini-blind has an openness angle a with 
respect to the vertical line shown in the drawing at the 
first leaf 202. The gap 203 between two leafs disappears 
when user adjusts the openness angle a of all leafs to 90 
degree and consequently the window portion from top to 
the position of the end piece 208 will be fully blinded, as 
a real mini-blind does to a real window. Note that unless 



the end piece is moved to the full extension position, 
some of the bottom leaves 213 will remain unexpanded 
and have an openness angle of 0 degree. The openness 
angle is adjusted through the user interface device 206, 
which functions like a wand tilter in a real mini-blind. The 
device 206 can be of any kind analog switch. Shown in the 
drawing is a particular embodiment using turn-wheel type 
switch to adjust the openness angle. 

[0016] Also in FIG. 2, the display monitor 201 has an outer frame 
204 which hosts another user interface devices 205. In- 
terface device 205 is an increment-decrement type of 
analog input device, functions like a lifting cord in a real 
mini-blind, for the user to move the position of end piece 
208 of the mini-blind up and down. This interface device 
is universally useful to all types, styles of window cover- 
ings. For the case of a vertical blind, the position of the 
blind is characterized by the side piece if the operation is 
to move all the leafs sideward, or by the center piece of 
the blind if the operation is to split in the center by mov- 
ing half of the leaves leftward and another half rightward. 

[0017] The Mode switch 207 is used to set the application mode 
to be simulation mode, TV mode if the monitor itself is a 
television set, normal display mode as computer monitor 



or as other video display application. 
[0018] it is obvious that, for the outdoor window simulation sys- 
tem to be more portable, the receiver, the memory stor- 
age for window structure and window covering informa- 
tion, and image processor are preferred to be imbedded 
inside the display monitor. The memory storage in partic- 
ular, can be merged with the memory in monitor such that 
the display for selection of a particular window structure 
and window covering type, style, and color is integrated 
with the menu built in the monitor. The selections user 
makes in this setup stage are stored as default values and 
will be used when the power is on, staying the same until 
user change them. User should also be allowed to change 
the window structure and window covering settings at 
run-time during the instant simulation image is on dis- 
play. The interface device 211 is used to serve for this 
purpose. Functionally, when the pushbutton device as an 
example of device 211 is pushed, a small popup will dis- 
play all possible choices for the user. A touch-screen con- 
trol will be appropriate in this case for user to select and 
highlight the desired item. Another push on the button 
will terminate the selection process and resume the in- 
stant simulation image with new selection of window cov- 



ering or new look of the window structure. 

[0019] The remote control device used for a television set is an- 
other place to imbed all the user interfaces and controls 
for simulation. One embodiment of present invention is to 
use a television set as the display monitor, the remote 
controller is usually available for the TV set and can be re- 
programmed such that the setup menu also include the 
selection of window structures and selection of window 
covering types, styles and colors, provided that the neces- 
sary memory storage and control circuit have also in- 
stalled and integrated with other circuit inside the TV set. 

[0020] | n the process of creating instant simulation image, any 
pixel location where it does not belong to window edges, 
window grid and window covering, should get it's pixel 
value from outdoor image. The gap 203 in FIG. 2, for ex- 
ample, should reveal a small portion of the outdoor im- 
age, otherwise the simulation will not look real and thus 
loses some fidelity. 

[0021] The static image is a combination of fixed window image 
and the window covering image. Fixed window image is 
relatively simple since the image will not change through 
the all display time, so the whole image can be pre- 
constructed and stored in the memory waiting for re- 



trieval. Some windows installed in the big building are not 
operable, have no edges, no window grids at all. Smaller 
operable window typically has upper and bottom halves, 
and each half has several grid members to separate it into 
2, 4, 6 or 9 equal regions. In fact, the window structure is 
simple enough to be constructed by using only some pa- 
rameters which represent the location coordinates of ver- 
tices of all edges, location coordinates of grid members, 
and their colors to reconstruct the fixed window images. 
[0022] By comparison, the window covering image is much more 
involved. A shade, for example, is a piece of cloth or other 
material folded to have many wavy pleats and sandwiched 
by a top piece and an end piece wood like strips. There is 
no leaves, so there is no leave angle to adjust. It shelters 
the window from the top to the end piece and the only 
adjustment user can manipulate is it's position. This is an 
example of window covering with only one degree of free- 
dom. In order to reconstruct the image of a shade ex- 
tended to a particular position, one can digitize the entire 
stroke of the position of the end piece into N steps. N 
should be large enough so that when end piece is moved 
from position i to i + 1, where i + 1 <= N, the transition in 
image change should look as smooth as possible. The 



pleats will be stretched flatter when the end piece is 
moved to extend the shade, so every position i corre- 
sponds to a width w of all pleats. Because all pleats are of 
same size w, a total of n such size pleats connected to- 
gether plus top and end pieces represent the completed 
shade being extended to position i. The entire shade is 
hold together in place by two thin ropes 212. To recon- 
struct the image for the entire shade extended to position 
i, all we need is the graphics of top and end pieces, the 
graphic of a pleat with width w. In other words, if in the 
memory we have stored graphics of top and end pieces 
and graphics of N pleats of distinct widths, we can recon- 
struct shade images for all N positions. When a user 
moves the increment/decrement input device starting at 
shade position i and finally stopping at position j, the im- 
age processor will retrieve the graphic for the pleat at 
each intermediate position and copy it to get a total of n 
pleats of the same size, combines them with top and end 
pieces to form a intermediate shade image, and continue 
to process the same way until the shade image at position 
j is reached. For better simulation fidelity, each graphic 
can have 3-D or animation effect. Each graphic of the 
pleat should also include small sections of the two thin 



ropes such that, when n graphics of the same pleats are 
combined together, the two thin ropes will look like ex- 
tending from top piece to end piece without interruptions. 
[0023] For other type window coverings with two degrees of free- 
dom, such as a mini-blind, has both openness and posi- 
tion to adjust, the modeling situation is different. The op- 
eration of a mini-blind is characterized by changing the 
leaves openness angle using a wand tilter and by expand- 
ing a number of leaves from it's total amount using the lift 
cord. Therefore, in this particular embodiment, N graphics 
of the leaves representing N openness angles are stored, 
along with graphics of the top and end pieces and other 
necessary information such as color of leaves. To recon- 
struct the image of a mini-blind at an openness angle a 
and an extended position p with the understanding that 
position p corresponds to m expanded and n-m unex- 
panded leaves of total number n, the image process will 
retrieve the graphic of leaf corresponding to openness an- 
gle a, duplicates it m-1 times to make m graphics of 
openness angle a, then combines them together to form 
the expanded portion of the mini-blind image. Image 
processor will also retrieve the graphic of leaf corre- 
sponding to openness angle of zero degree, duplicates n- 



m-1 times, combines them together to form the unex- 
panded portion of the mini-blind image. Top piece and 
end piece are then added to complete the entire mini- 
blind image. During the combination of m leaves for the 
expanded portion of the blind image, a gap of amount g 
which depends on the openness angle will be added be- 
tween blind leaves and the pixel values of these gaps will 
be replaced later by pixel values from same locations in 
the outdoor image when the instant simulation image is 
reconstructed. The image reconstruction process will be 
repeated every time when the user operates the interface 
205 to move blind up and down or interface 206 to 
change the leaves openness of the blind. 
[0024] Alternatively, if the memory size is big enough, one can 
use a digital camera, take the pictures of a real shade ex- 
tended at N different positions, manually edits all pixels 
not belong to the shade with a special pixel value uni- 
formly and then store them as shade image templates for 
retrieval. When a static image is required, the image pro- 
cessor retrieves fixed window image and the shade image 
template corresponding to desired position, combines 
them together, with the understanding that whenever a 
pixel is overlapped from both images, the shade image 



pixel will be used as new pixel value. In such way, the 
static image for desired window structure and shade can 
be created. In creating instant simulation image we note 
that all the pixels in static image with uniform special 
value will be replaced by pixel values of the outdoor im- 
age at same locations. So for window coverings of one de- 
gree of freedom, we can reconstruct the static image in 
similar way. For two degrees of freedom window coverings 
such as a vertical blind, it is difficult to store all images 
for every digitized openness angle and every digitized po- 
sition, because if 100 positions and 90 angles are used, 
there will be 9,000 images to be stored and roughly 9 gi- 
gabyte memory is needed even if the resolution of each 
image is as low as lmegapixels. It will then be possible 
for this embodiment without a big storage memory if a 
suitable image compression method is available without 
losing too much of the image quality when used. Other- 
wise, a scheme to reduce the number of images stored is 
necessary. Actually, one needs only to store the images 
for all digitized openness angles as image templates and 
then reconstruct the images for all positions based on 
these templates. Every image template is a digital picture 
taken at a specific openness angle, preferably with only 



one leaf expanded and the rest unexpanded. When a ver- 
tical-blind image of desired position and specific open- 
ness angle is needed, the template corresponding to de- 
sired angle is retrieved. Based on the desired position, 
some number of expanded leaves will be and the same 
amount of the unexpanded leaves will be reduced to 
match the desired position. Unfortunately, this way of re- 
constructing image for window covering of two degrees of 
freedom does not improve much as compared to the total 
reconstruction method mentioned in previous paragraph. 
If the memory size not a problem and good image com- 
pression scheme is available, it is a better implementation 
to store images for all digitized positions and all digitized 
openness angles for retrieval. 
[0025] The size of display monitor for present invention depends 
on the size of the room to install the system, but there is 
no strict rule to follow. Currently, the largest commercially 
available size for plasma monitors such as NEC Plas- 
maSync 61MP by NEC Corporation of Japan is 61" diago- 
nally and has aspect ratio of 16:9, which is roughly 
53"x30" in length by width. With such size display moni- 
tor, it should be big enough for most windowless room to 
display a simulated outdoor scene with operable artificial 



curtain. Largest size for commercially available LCD moni- 
tors is 40" diagonally, also by NEC with model name 
LCD4000, translates into 34"x20", is bigger than many 
small real windows, therefore should be big enough for 
many small rooms. For the purpose of application in 
present invention, the sizes of available monitors is thus 
not a problem. The thickness of the monitors are thinner 
than 4" for largest plasma monitor, which is thin enough 
to look like a real window mounting on the wall. The 
weight of monitor, around 150 pounds for largest plasma 
monitor, is light enough not to cause too much trouble 
mounting on the wall. The only concern is the price of big 
size display monitors. However, as happened to all other 
electronic products, the price will drop sharply as the 
popularity of digital TV increases to some point. 
[0026] The frame 204 in FIG. 2 can be framed with a wood mold- 
ing for better look and more similar to a real window. 
Normally, a mini-blind equips with a lift cord 214 for 
moving the end piece up and down. Since we already have 
device 205 functions as generic lift cord for all window 
coverings, item 214 is in the display just for higher simu- 
lation fidelity. Similarly, The wand tilter 215 is in the dis- 
play for the same purpose since it's function has been im- 



plemented by device 206. 
[0027] Although the invention has been illustrated with some 
particular embodiments, variations and modifications 
within the scope of the invention are very possible. Fi- 
delity of simulation will also vary with the graphics of the 
window coverings. Whatever the variation is, it will achieve 
the goal of present invention-a method and apparatus to 
simulate an outdoor scene visible window for a window- 
less room, with a plurality of different types, different 
styles and different colors of operable simulated window 
coverings to choose from. In addition, the display monitor 
can be used for other purpose such as displaying DVD 
movies. Present invention is not only a multi-purpose de- 
vice, but also a good decoration item for a windowless 
room. Hopefully, some employees work in big building 
will prefer windowless room equipped with outdoor win- 
dow simulation system by present invention which offers 
many variations of window coverings and different views 
decided by location of video cameras over the room with 
real outdoor window because real window equipped with 
fixed style window covering and can only see the view im- 
mediate outside the window. 



